WORLD INTEliECTUAL PROPERTY ORGANIZATION 
International Bureau 




PGT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification ^ : 
G06F 17/30 



Al 



(11) International Publication Number: WO 99/18523 

(43) International Publication Date: IS April 1999 (15.04.99) 



(21) International Application Number: P(rr/US98/20483 

(22) International FOing Date: 6 October 1998 (06.10.98) 



(30) Priority Data: 
08/947,435 



8 Octc^ 1997 (08.10.97) 



US 



(63) Related by Continuation (CON) or Continuation-in-Part 
(CIP) to Earlier Application 

US 08/947.435 (CON) 

Filed on 8 October 1997 (08.10.97) 



(71) Applicant (for ail designated States except US): CAERE 

CORPORATION [US/US]; 100 Cooper Court, Los Gatos, 
CA 95030 (US). 

(72) Inventors; and 

(75) Invent«»^Applicants (for US only): FERGUSON. David. R. 
[US/US]; 4265 Mattos Drive, Fremont, CA 95436 (US). 
HONG. An. N. lUS/US]; Apartment B. 1966 Hackett 
Stieet. Mountain View. CA 94043 (US). SUI^MAN, Dani 
[ID /USl; 6 021 Commerce Drive. Fremont, CA 94555 (US). 
WHITTEMORE. Grcgoiy. L. [US/US]; 14590 Homerite 
Mve, San Jose, CA 95124 (US). 



(74) Agent: PETERSON. James, W.; Bums, Doane. Sweckcr & 
Mathis, L.L.P.. P.O. Box 1404. Alexandria. V A 22313-1404 
(US). 



(81) Designated States: US. European patent (AT. BE. CH. CY, 
DE, DK. ES, n. FR. GB. GR, IE, IT, LU. MC. NL. PT. 



Published 

With international search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



(54) Title: <X>MPUTER-BASED DOCmiENT MANAGEMENT SYSTEM 



nie Edit View Tools Test Fj3e 
tOfO-y^ J[ja AO Docum^ 



ABrowger-My Computer AB Documents 







1 






m 


m 









CVgorVesttAieaif C:\J9a'\te$tti(\11.ti( C:\l9ar\te«lli(\12.m C:V9>r\testti(\l3.tH 



11 



ll 




II 



C:\l9or\te«tlAl4l'rf C:V9or\lcsttHV5.tif C:V9»\l«tli^10.Uf C:\l90rVestUf\l7.tif 





G VgorVesttAlfi-W Cs\I9or\l«stU^I9.Uf 



tors 



Ready 



C V9or\tesfU^20.tif C: V9orVesttif\21.tif 



(57) Abstract 

A computer-based electronic document and/or paper-based document management application program. The program provides an 
efficient way to automatically import, index, categorize, store, search, retrieve, manipulate and archive electronic documents. The program 
is also capable of managing documents regardless of document type or document format. 



3NSD0C1D: <WO ^g9lB523AlJ.> 



FOR THE PURPOSES OF INFORMATION ONLY 
Codes used to identify States party to tfie PCT on the ftont pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


AM 


Armenia 


FI 


Finland 


LT 


AT 


Austria 


FR 


France 


LU 


AU 


Austrafia 


GA 


Gabon 


LV 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


BA 


Bosnia and Hevz^ovina 


GE 


Georgia 


MD 


BB 


Barbados 


GH 


Ghana 


MG 


BB 


Belgium 


GN 


Guinea 


MK 


BF 


Burkina Faso 


GR 


Greece 


EG 


Bulgaria 


HU 


Hungaiy 


ML 


BJ 


Benin 


IE 


Ireland 


MN 


BR 


Brazil 


IL 


Israel 


MR 


BY 


Belarus 


IS 


Iceland 


MW 


CA 


Canada. 


IT 


Italy 


MX 


CF 


Central African Republic 


JP 


Japan 


NE 


CG 


Congo 


KE 


Kenya 


NL 


CH 


Switzerland 


KG 


Kyigyzstan 


NO 


CI 


C6te d'Tvoire 


KP 


Democratic People's 


NZ 


CM 


Cameroon 




Rqniblic of Korea 


PL 


CN 


China 


KR 


Republic of Korea 


FT 


CU 


Cuba 


KZ 


Kazakstan 


RO 


CZ 


Czech Republic 


LC 


Lucia 


RU 


DE 


Germany 


U 


Liechtenstein 


SO 


DK 


Denmark 


LK 


Sri Lanka 


SB 


EB 


Estonia 


LR 


Liberia 


SG 



Lesotho 


SI 


Slovenia 


Lithuania 


SK 


Slovakia 


Luxembooig 


SN 


Senegal 


Latvia 


sz 


Swaziland 


Monaco 


TD 


Chad 


Republic of Moldova 


TG 


Togo 


Madagascar 


TJ 


Tajikistan 


The fonner Yugoslav 


TM 


Turkmenistan 


Republic of Macedonia 


TR 


TOrkey 


Mali 


TT 


Trinidad and Tobago 


Mongolia 


UA 


Ukraine 


Mauritania 


UG 


Uganda 


Malawi 


US 


United States of America 


Mexico 


uz 


Uzbdristan 


Niger 


VN 


Viet Nam 


Netherlands 


YU 


Yugoslavia 


Norway 


ZW 


Smbabwe 



New Zealand 
Poland 
Portugal 
Romania 

Russian Federation 

Sudan 

Sweden 

Smg^KYie 



AnnniD: <WO S91B523A1 I > 



wo 99/18523 



PCT/US98AX0483 



COMPUTER-BASED DOCUMENT MANAGEMENT SYSTEM 

BACKGROUND 

The present invention relates to computer-based document management 
systems. More particularly, the present invention relates to a conq>uter-based 
5 document management system that has the capability of importing, organizing, 
browsing, searching, and viewing paper-based docimients and electronic 
docmnents of any t5^e or format from various sources. 

In today's business environment, most businesses, from small businesses to 
large corporate entities, organize and maintain a tremendous amount of 

10 information, particularly information in the form of paper-based docmnents and 

electronic documents. The task of organizing and maintaining such a large number 
of docmnents, can, and typically is, a time consuming and costly matter. 

In response, the conq>uter industry, particularly the computer software 
industry, offers a ntmiber of computer application programs designed to help 

15 mitigate this problem. Some of these computer application programs work in 

conjunction with optical scanners to automatically import paper-based documents 
into a host conq)uter. Other application programs are directed more specifically at 
providing electronic file management services for existing electronic documents. 
Some of the more advanced computer application programs attempt to integrate a 

20 number of different capabilities into a single application program. Among the 
capabilities that some of the more advanced programs provide are automated 
document importing, storage, manipulation, retrieval, indexing, and document 
annotation. 

However, despite the many features already offered by existing software 
25 products, there is still a need to improve the efficiency of these products. This is 
especially true with respect to the way in which fliese prior products import, store, 
and otherwise organize electronic documents within a document collection. For 
example, current products do not provide an efficient way in which to import 
docimients into a single docimient collection, nor do they provide an efficient way 

-1- 

3NSOOCID: <WO 9918523A1J_> 



wo 99/18523 PCTAJS98/20483 



in Which to continuously and automatically update the document collection as new 
documents are added, and as existing documents are modified and/or deleted. 
Existing software products also do not efficiently manage document collections 
consisting of documents that exhibit one of many different data formats. In 
5 addition, existing products do not efficiently store documents in memory, 

especially wherein documents may appear to be stored in and/or linked to more 
than one location and/or document category. Consequently, managing a large 
document collection can be a formidable task even with the assistance of various 
software products presently on the market. Therefore, the ability to automaticaUy 
10 import, store, organize and manipulate the document coUection with mmimal user 
interaction, and to do so m a most memory efficient way, would be most desirable. 

SUMMARY 

The present invention is directed to a method for managing documents in a 
con^uter-based system. The present invention provides a number of 
15 improvements over prior methods, particularly, the way m which the present 

invention mdexes. categorizes and stores a wide range of documents and document 
types in its electronic database. 

Accordmgly, it is an objea of the present invention to standardize the way 
in which document information is maintained regardless of document type or 
20 document format. 

It is another object of the present invention to automaticaUy index and 
categorize a large quantity of paper-based and electronic documents and document 
types. 

It is another object of the present invention to efficiently and automatically 
25 store, browse, and view a large quantity of paper-based and electronic documents. 

It is still another object of the present invention to automatically modify 
and/or manipulate a large quantity of paper-based and electronic documents. 

In accordance with one aspect of the present mvention, the foregoing and 
other objects are achieved by a method of managing a document collection in a 
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computer system that involves importing a document into the computer system; 
then storing the document in a memory location; automatically extracting attribute 
data from the document; and generating a data stmcture for the document. 
Moreover, the data structure contains the attribute data in a standardized format 
5 regardless of docmnent type or document format. 

In accordance with another aspect of the present invention, the foregoing 
and other objects are achieved by a computer-readable storage medium that has 
stored therein a program which is capable of in^jorting a document into a 
computer-based system; storing the document in memory; automatically extracting 
10 attribute data from the document; and generating a data stmcture corresponding to 
the document. The data stmcture generated by the pfrogram contains the extracted 
attribute data in a staiKiardized format regardless of document type or document 
format. 



BRIEF DESCRIPTION OF THE DRAWINGS 

15 ,> The objects and advantages of the invention will be understood by reading 

the following detailed description in conjunction with the drawings, in which: 

FIG. 1 A is a diagram of a general purpose computer which could be used 
to implement the present invention; 

FIG. IB is a diagram illustrating some of the features and utilities 
20 employed by the present invention; 

FIG. 2A is an exemplary representation of an STG file associated with a 
document; 

FIG. 2B is an exemplary representation of an STG file associated with a 
clipped dociunent; 

25 FIG. 3 depicts the hierarchical organization of an exemplary document 

collection in accordance with the present invention; 

FIG. 4 is a screen display of the user interface associated with the change 
notification utility; 

FIG. 5 is a screen display of a first scanner preferences user interface; 
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HG. 6 is a screen display of a second scanner preferences user interface; 
HG. 7 is a screen display of a third scanner preferences user interface; 
HG. 8 is a screen display of a fourth scanner preferences user interfece; 
HG. 9 is a screen dispky of the scanner control interface; 
5 HG. 10 is a screen display of a first Browser utility user interfece; 

HG. 1 1 is a screen display of a second Browser utility user interface; 
HG. 12 is a screen display of the second Browser utUity user interface with 
a customizable application toolbar; 

HG. 13 is a screen display of a third Browser utility user interfece 
10 containing icons representing transitional documents; 

HG. 14 illustrates the user interface for conducting a basic document 

search; 

HG. 15 illustrates the user interface for conducting an advanced document 

search; 

15 HG. 16 is a screen display of the document viewing utility user interface; 

HGs. 17A-D Ulustrate a drag and drop operation in conjunction with the 
creation of a clipped document; 

HG. 18 is a screen display of the file helper user interface; 
HG. 19 is a screen display of a secondary file helper utiUty user interface; 
20 HG. 20 is a screen display of the directory monitor user interface; 

HG. 21 is a screen display of the task manager user interface; and 
HG. 22 is a screen display of the system task bar illustrating the task 
manager icon. 

DETAILED DESCRIPTION 
25 The present invention involves a system and/or method for managing 

electronic documents in a general purpose conqjuter, such as the general purpose 
computer 100 Ulustrated in HG. lA. The present invention further includes a 
system and/or method for importing electronic documents and electronic 
represemations of paper-based documents from any number of different sources. 
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For example, the present invention is capable of importing electronic 
representations of paper-based documents from a scanner 105, word processing 
documents from an internal memory such as a RAM (not shown) or an external 
memory 115 (e.g., a hard drive), e-mail from an internet connection 120, or a 
5 document containing graphical image data from a server 125 supporting a local* 
area network, to which the general purpose computer 100 is connected. Once a 
document has been imported, the present invention employs a system and/or 
method for automatically categorizing, indexing, browsing, viewing and otherwise 
manipulating the document, along with each of the other docun^nts contained in 

10 what is herein referred to as the docimient collection. As one skilled in the art will 
readily appreciate, the present invention can be implemented in software, using 
standard prognumning methods and techniques which are well known in the art. 

The present invention onploys a number of core features 150 as well as a 
number of document management utilities as illustrated in FIG. IB. The core 

15 features 150 refer to certain attributes or characteristics that the present invention 
employs and/or executes in the background to support the various document 
management utilities. For the purpose of simplicity, the following description of 
the present invention is divided into the various core features 150 and document 
management utilities. The order in which each invention feature and/or utility is 

20 presented herein below is not intended to limit the present invention in any way. 
Rather, the scope of the invention is given by the appended claims. 

DATA STORAGE (STG) FILES 

The first core feature 150 of the present invention is a unique data storage 
(STG) structure referred to herein as an STG file. The present invention maintains 
25 an STG file for each document in the document collection. A new STG file is 
created for each new document, and an existing STG file may be updated if the 
corresponding document is modified. 
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Each STG file contains a number of standardized data fields. This provides 
a way to maintain various attribute data and other information for a given 
document in a common, standardized format regardless of the document's type 
(e.g., text document versus image document) or the document's format (e.g., 
5 JPEG versus HTML). In a preferred embodiment, aU STG files are stored in a 
common disk directory. 

FIG. 2A represents an exemplary STG file 200 along with some of the data 
fields that may be contained therein. For example, STG file 200 may include a 
data field 205 which contains a file name, e.g., "001. STG", to identify die 

10 corresponding STG file 200. The STG file 200 may also include a data field 210 
and a data field 215 which reflects the memory location of the corresponding 
document and a bit map defining a r^resentative thumbnail respectively. The 
STG file 200 may also contain a data field 220 which reflects the raw text 
associated with the corresponding document. The raw text data is primarily used 

15 for indexing purposes. Indexing is described in greater detail below. In addition, 
the STG file 200 is likely to contain a number of other data fields (not shown) for 
such attributes as document author, publishing date, word count, annotations, 
and/or key words if the document belongs to a particular category. Categories and 
categorization of documents are also explained in detail below. If the document 

20 corresponding to the STG file is an image document, data fields may be included 
for such attributes as image type (e.g., color, black and white, or gray scale), 
hnage dimension, and/or image meta-text with text positioning information. 

An STG file also exists for each clipped document stored by general 
purpose computer 100. A clipped document is a special type of conqwund 

25 document data structure. Typically, a clipped document incorporates a number of 
related or component documEsits in a particular document order similar to 
attaching a number of physical documents together with a p^r clq). When a 
clipped document is created, an STG file is gfenerated. Unlike STG files 
associated with individual documents, an STG file associated with a clipped 

30 document includes a data field having its own file name, e.g., "002.STG" and a 
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number of additional data fields which contain the identity of the STG files 
corresponding to the component docmnents. FIG. 2B shows an exemplary STG 
file 250 that is associated with a clipped document. As illustrated, STG file 250 
links the clipped document with four component documents, wherein the STG files 
that correspond with the four component documents are identified by their file 
names as follows: lOO.STG, 101. STG, 211. STG and 084.STG. Clipped 
documents are described in greater detail below. 

Aside fi-om creating an STG file for each new document and each new 
clipped document, an existing STG file may be updated if the corresponding 
document or clipped document is edited or modified in some way. For exanq>le, if 
a user modifies an existing word processing document, upon saving the modified 
version of the document, the corresponding STG file is updated, if necessary, 
particularly the text data field 120. 

ORGANIZATION OF THE DOCUMENT COLLECTION 

15 In a preferred embodiment, the document collection is organized into a 

hierarchy of files, clipped documents, and electronic folders, wherein electronic 
folders may, in turn, contain additional files, clipped documents and nested 
folders. The data that defines how the hierarchy of files, clipped documents and 
electronic folders are organized wifli respect to each other is maintained in a 

20 compound data structure referred to herein as the document collection organization 
(DCO) file. 

The DCO file is the second core feature described herein, and it contains, 
in essence, all of the information necessary to resurrect or reconstmct the 
document collection hierarchy, which takes on the appearance of an organizational 
25 "tree" 300, as illustrated in FIG. 3. For example, the DCO file contains the 

information necessary to establish that folder F, contains two nested folders Fj and 
F3. In addition, this exemplary DCO file contains the information necessary to 
establish that there are a number of documents D^, Dj, D3 and D4 directiy 
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associated with folder F,; that there are two documents D3 and D4 direcUy 
associated with folder Fj; that there are two documents D5 and D^, as well as a 
nested folder F^ associated with folder F,; and that folder F* contains a document 
D4 and a clipped document S. 
5 In accordance with another aspect of the present invention, each user, in a 

multiple-user environment, has the ability to create a user profile for a local 
terminal or workstation. The user profile, in essence, defines a "local" version of 
the primary document collection and the document collection hierarchy, which are, 
in turn, defined by the various STG files and the DCO file respectively, as 

10 described above. The user profile may define the local document coUection such 
that it mcludes aU of, or a portion of, the documents in the primary document 
collection. The user profile may also define the local document collection such 
that it reflects a different document coUection hierarchy than the one defined by the 
DCO file for flie primary doomient collection. 

15 This is accomplished, in part, by mamtaining a local STG file for each 

document in the local document coDection. In addition, a local version of the 
DCO file is maintained, which defines the hierarchy of the documents in flie local 
document coUection. Although a user can, of course, alter the content of an 

existing document in the primary document coUection by manq)ulating the 
20 document locally, and hence, flie content of the STG file associated witii that 

document, the user profile cannot alter the document coUection hierarchy defined 
by tte DCO file for the primary document coUection. 

VIRTUAL DOCUMENT STORAGE 

The present invention also en^loys a virtual document storage scheme. 
25 Vutual document storage is the third core feamre described herem. 

FIG. 3 illustrates the concept of this vutual document storage feature. It 
wiU be recognized that document D4 appears in several folders wifliin the 
organizational hierarchy 300. First, it is associated with folder F,. Next, it is 
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associated with folder Fj. Finally, it is associated with folder F4. However, in 
accordance with a preferred embodiment of the present invention, this does not 
mean that three copies of document D4 are stored in the DCO file. On the 
contrary, the content of document D4, as with each and every document in the 
5 document collection, is stored in its entirety in but one memory location, and the 
DCO file links folders F,, Fj and F4 to the one copy of document D4 by providing 
a pointer from each folder F„ Fj and F4 to the STG file 310 associated with the 
document D4. 

The virtual document storage feature saves memory space, it simplifies the 
10 task of updating files, and it guarantees document integrity by maintaining but one 
version of a given document, as one skilled in the ait will readily understand. For 
exan^)le, if a user modifies an existing document, such as document D4, the 
modifications are reflected in the affected data fields in the corresponding STG file 
310. Consequently, these modifications are reflected whenever the user, at a later 
15 time, accesses the document D4 through folder Fj, Fj or F4. 

INDEXING AND RETRIEVING 

In addition to the core features 150 described above, the present invention 
employs a number of dociunent management utilities. The first of these utilities is 
the indexing and retrievmg utility 157, the focus of which is an index and retrieval 

20 engine. The index and retrieval engine, among other things, maintains an indexing 
database comprising an index or list of each document in the document collection 
and a cross-reference between each docxmient in the document collection and 
various key terms and/or document attributes that are stored for each document in 
the corresponding STG file. The indexing database, in turn, is printiarily used to 

25 support the document search function, which is described in greater detail below. 
Briefly, however, the present mvention employs a search engine which has the 
ability to compare the information in the indexing database with one or more user- 
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supplied search terms or attributes. Documents whose indexing information match 
the user-supplied search terms or attributes are then identified and/or retrieved. 

The mdex and retrieval engine also continuously updates the indexing 
database. For example, when a new document becomes part of the document 
5 collection, an STG file is created for that document, as explained above. In a 
preferred embodiment, the index and retrieval engine also creates a new entry in 
the indexing database for the new document, cross-referenced with key terms and 
other attributes extracted from the new docimient's STG file. 

In addition, the index and retrieval engine continuously monitors the 
10 contents of existing STG files. If a document is modified, and if the modification 
is reflected in the corresponding STG file, the mdex and retrieval engine updates 
the indexing database accordingly. 

Another related utility is tfie Universal Resource Locator (URL) indexing 
module. Essentially, a URL is a World Wide Web site that furnishes information 
15 regarding the location and, in some cases, the content of particular Web sites 

and/or Web documents. The URL indexing module provides the ability to index 
this information so that a user can more effectively access a Web site or retrieve a 
particular web document as if it were any other document stored in the document 
collection. 

20 In the present invention, there are three exemplary embodiments for 

implementing the URL indexing module. The first exemplary embodiment 
involves auto-indexing "bookmarks". A bookmark is an entry in a list of 
commonly used web sites. In accordance with this embodiment, an STG file is 
created for each bookmark. The second exemplary embodiment involves 

25 physically copying a URL into memory, and indexing information relating to that 
URL. In this embodiment, an STG file is created for the URL. The third 
exen:q)lary embodiment involves viewing a particular document located at or 
identified by a particular URL. Again, information relating to this document may 
be indexed as with any document in the document collection. Moreover, an STG 

-10- 



wo 99/18523 



PCTAJS98/20483 



file is created for the docxunent, and the document can be imported through the 
Browser utility, which is described below. 

CATEGORIES AND CATEGORIZATION OF DOCUMENTS 

The present invention also enq>Ioys a categorization utility 159 that 
5 provides different levels of automated assistance in organizing the document 
collection. A category is a logical grouping of documents that share some 
conmion attribute or attributes, sometimes referred to as category criteria. For 
exanqple, a category may consist of a number of dociunents that share a common 
author, a nim[)ber of documents that contain at least a predefined number of words, 
10 a nimiber of documents that contain certain key words, or a number of dcicuments 
that share a common concept. A more specific exanq>le might be a category called 
"company press releases'* or a category called "all e-mails I've sent out". 
Categories can also be defined hierarchically. In other words, a category may 
have a subcategory. For example, "all e-mails I've sent out to my group" might 
15 be a subcategory of "all e-mails I've sent out". 

The categorization utility 159 inq>lenients a category by associating a 
corresponding set of category criteria with a folder in the document collection 
hierarchy; however, it will be recognized that not every folder in the document 
collection hierarchy is associated with a category. For example, in FIG. 3, folder 
20 Fj is associated with a category as indicated by the sjonbol "*". However, folders 
Fi, F3 and F4 are not associated with a category. 

Folders that are associated with a category are, in general, referred to 
herein as "smart" folders. They are referred to as smart folders because the 
categorization utility 159 continuously searches through the STG file directory, or 
25 a portion thereof, for documents that match the category criteria associated with 
each smart folder. If a match is identified, the categorization utility 159 generates 
a link between the smart folder and the matching document, through the matching 
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document's STG file, thus creating the appearance that smart folders automatically 
collect matching documents without user interaction. 

As stated, the categorization utility 159 may only search a portion of the 
STG directory for documents that match the category criteria of a given smart 

5 folder. In an exemplary embodiment of the present invention, the categorization 
utility 159 limits its search of the STG directory to only those STG files associated 
with documents that are linked to the smart folder's parent folder. For example, in 
FIG. 3, Fj is a smart folder. In accordance with this exemplary embodiment, the 
categorization utility 159 searches the STG files associated with F^, wherein Fi is 

10 the parent folder of F2. Accordingly, the categorization utility 159 only searches 
through the STG files associated with the documents D„ D3 and D4. At 
present, only the documents D3 and D4 match the category criteria associated with 
the smart folder Fj- 

Generating a link between a document and a smart folder may occur after 

15 an STG file is created for a new document, or it may occur after an existing STG 
file has been updated due to the modification of its corresponding document, 
wherein the modification caused the document to meet the category criteria of the 
smart folder. Sin[ularly, if a document is modifi^ such that the modification 
causes the document to no longer meet the category criteria of a particular smart 

20 folder, the link between that document's STG file and the smart folder may be 
eliminated. 

In accordance with a preferred embodiment of the present invention, the 
categorization utility 159 categorizes documents under various smart folders using 
one of three possible categorization methods: auto categorization; semi-automatic 
25 categorization; or manual categorization. 

With manual categorization, a document, through its corresponding STG 
file, is linked with a particular category, hence a particular folder, when a user 
physically "drags and drops" a display screen representation of the document onto 
a display screen representation of the folder. As the categorization utility 159 did 
30 not previously nor automatically categorize the document with this folder, the 
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folder is either not a smart folder or it is an inactive smart folder, or the folder is 
an active smart folder, but the document does not otherwise match the 
corresponding category criteria. Active versus inactive smart folders are explained 
in more detail below. 
5 Semi-automatic categorization involves categorizing a document into any 

one or more categories with minimal user interaction. Here, the user constructs 
category criteria in the form of a query. The query, in turn, comprises one or 
more key terms and/or document attributes which define the category. The user 
may also restrict the scope of the query, for example, to particular directories or 

10 document types. The category criteria are then associated with a folder, i.e., a 
smart folder, and the categorization utility 159 continuously searches through all 
or a portion of the STG files for documents that have attributes matching the 
category criteria. If a matching document is identified, a new link is established 
between the corresponding smart folder and the matching document through the 

15 docmnent's STG file. 

Automatic categorization involves categorizing a document into one or 
more categories without any user interaction. Here, each category is represented 
by a smart folder that initially contains a "seed" document. The "seed" document 
is then analyzed by the categorization utility 159, and the category criteria (i.e., 

20 the key words and/or attributes) are atitomatically extracted. Existing documents 
and new documents that match the automatically extracted category criteria are 
linked with the smart folder through their corresponding STG files. 

The categorization utility 159 can utilize the indexing information to 
examine the relationship between the various docimients within a particular 

25 category. This feature scores or ranks the relationships. For example, documents 
that share a large number of key terms are considered closely related; those that do 
not share a large number of key terms are considered less related. The 
categorization utility 159 can display the results in the form of an organization 
hierarchy "tree". Branching high in the organizational hierarchy denotes a close 
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relationship, while branching low in the hierarchy denotes a more distant 
relationship « 

In a preferred embodiment, a user can modify the category criteria 
associated with a smart folder. This is accomplished through a "modify category 
5 criteria" user interface. Changing category criteria may result in the categorization 
utility 159 purging documents from the corresponding category if the documents 
no longer match the category criteria. In addition, the categorization utility 159 
initiates a search using the modified category criteria, to identify additional 
documents in the document collection that are now relevant given the new category 
10 criteria. 

In a preferred embodiment of the present invention, a user may designate a 
smart folder as active or non-active. For each active smart folder, the 
categorization utility 159 continuously searches the STG file directory, as 
described above, for documents that match the category criteria associated with 

15 each of the smart folders. For inactive smart folders, the categorization utility 159 
does not continuously search the STG file directory for documents that match the 
category criteria of the various inactive smart folders; however, a user is able 
manually categorize a document with a non-active smart folder. Active smart 
folders are sometimes referred to as "hungry" folders. 

20 Smart folders can also be reactive. In accordance with a preferred 

embodiment of the present invention, a user can program a sniart folder with 
particular behavioral characteristics, such that a particular task or tasks are 
automatically performed on or with the documents linked with that smart folder. 
For example, the user may program a smart folder to automatically e-mail all 

25 documents stored therein to a particular e-mail address. In another example, the 

user may program a smart folder to periodically display folder updates, such as the 
addition or deletion of new docimients. 

With respect to semi-automatic and automatic categorization, there are two 
filter types associated with each smart folder. The first filter type generates an 

30 inclusion list. The inclusion list identifies those documents that were not 

-14- 



»XX;]0:<WO 991B523A1 t > 



wo 99/18523 



PCTAJS98/20483 



automatically included in the category associated with the smart folder during the 
categorization process. The inclusion list may provide the user with an indication 
that the category criteria associated with that category are too restrictive. The 
second filter type generates an exclusion list. The exclusion list identifies those 
5 documents that were not automatically excluded from the category associated with 
the smart folder during the categorization process. The exclusion list may provide 
the user with an indication that the category criteria associated with that category 
are not restrictive enough (i.e., the category criteria is too aggressive). Both lists 
are manually manipulated by the user. Accordingly, the user can modify the two 

10 lists as needed. 

As explained above, the data defining the links that are established between 
the various smart folders and the documents in the document collection are 
maintained in the DCO file. If a user nK)difies ^e contents of a document and that 
modification causes a change in the link or links between that document, through 

15 its corresponding STG file, and one or more smart folders, a change notification 
utility (not shown in HG. IB) updates the DCO file to reflect the changes 
accordingly. More specifically^ the change notification utility modifies the DCO 
file to reflect die newly created links and/or the deletion of links. The change 
notification utility also updates the thumbnail representations if needed. And if the 

20 user deletes a document in its entirety, the change notification utility deletes all of 
the links associated with that document from the DCO file. 

The user interface for the change notification utility is illustrated in FIG. 4. 
This user interface allows the user to select a few preferences with respect to the 
change notification utility. More particularly, the user can select how often the 

25 utility is to perform the updates, as well as the type of file changes that triggers an 
update notification. 



-15- 



wo 99/18523 



PCTAJS98/20483 



IMPORTING DOCUMENTS 

The present invention also employs a document importing utility 161 . The 
document importing utility permits the present invention to import electronic 
documents or electronic representation of paper-based documents from various 
5 sources. For exanq>le, the document importing utility 161, as shown in FIG. lA, 
can import documents from a scanner, from an external memory such as a hard 
drive, from a LAN, or from the internet. 

The first feature associated with the document importing utility 161 is the 
scanner module. The scanner module controls a scanner connected to the host 
10 computer system. More specificaUy, the scanner module allows the user to set-up 
the scanner. It also confrols the scanning process and the process of saving the 
electronic representation of the document bemg scanned. 

In a preferred embodiment of the present invention, there are a number of 
user interfaces associated with the scanner module. The first user interface is the 
15 scanner preferences interface, and there are four display options associated with 
the scanner preferences interface. The first display option allows the user to 
define various scanner options, as illustrated in HG. 5. The second display option 
is for defining image file options, as iUustrated in HG. 6. The third display is for 
setting-up scan-toK^ategory options, as illustrated in HG. 7. This option permits 
20 the user to scan a document directiy into a desired category. The fourth is for 

defining options with respect to multiple page documents, as illustrated in FIG. 8. 

Witii particular regard to tiie multiple page option interface illustrated in 
FIG. 8, tiiis set of user-defined options is for controlling die scanner's automatic 
document feeder (ADF). Of course, this particular scanner preference option is 
25 enabled only if die scanner has an ADF. If the user selects die "Check ADF 

continuously" box 805, die scanner is polled at a predefined interval to determine 
whetiier there is paper in die ADF waiting to be scanned. If diere is paper in die 
ADF. it is scanned, and die document is saved according to die odier above- 
identified scanner preference options. If diere is more dian one page being 
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scanned, there are a number of additional options as illustrated in FIG. 8. If the 
user selects the "prompt for more pages at the end of the scan" box 810, the user 
will be prompted to api^end additional pages to the document at the end of the 
current scanning operation. 
5 The second user interface associated with the scanner module is the scanner 

control interface. The scanner control interface is illustrated in FIG. 9. When the 
scan button 905 in the center of the scanner control interface is selected, the 
scanner module begins scanning a document in accordance with the scaimer 
preference options described above. If the user selects the scanner control 
10 interface title bar 910, the scanner preferences interface described above is be 
displayed, thus allowing the user to accept or change the current scanner 
preference options. 

As previously stated, an STG file is created for each new document in the 
document collection. In addition, the index and retrieval engine indexes each new 
15 document based on the attribute data in the corresponding STG file, and the 
categorization utility 159 links each new document with the appropriate smart 
folders. Each of these features holds tme for new documents that have been 
scanned into the document collection as well as those which have entered the 
document collection via other mechanisms. This saves the user from having to 
physically interact with a particular document or documents after they have been 
scanned. 

The second feature associated with the document importing utility 161 is 
the file import module. The file import module is responsible for extracting and 
saving attribute information in the STG file of a newly imported document. The 
attribute information extracted from each document by the file import module 
depends, to some extent, iq>on the file type. With regard to word processing type 
doctunents, the file import module extracts and saves the raw text information. 
The file import module also extracts a 96 x 96 pixel map for gec^rating a 
thumbnail image of the first page of each document. Thtmobnails contain actual 
document information, and are primarily used in conjunction with the Browser 
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utility to help a user quickly identify specific files. FIG. 10 illustrates an 
exemplary display from the Browser utility which contains a number of thumbnail 
representations 1005 for the category entitied "My Documents" as indicated in text 
box 1010. For image files, the file import module extracts a thumbnail map and 
5 any meta-text associated with the image file. Meta-text contains the content and 
position information for any alpha-numeric information appearing in the image. 
The file import module then converts the alpha-numeric information into plain 
text. The plain text can then be used by the index and retrieval engine as 
described above. Therefore, image files can be indexed and categorized just like 
lb word processing and other text files. 

When a color image containing text is to be scanned, the user can specify 
that the color image is to be scanned using a two-pass scanning process. The first 
pass is a low resolution scan which converts the document into a desired image 
format, e.g., TIFF, JPEG etc.... The second pass is a higher resototion pass that 
15 isconductedona non-coloror non-gray scale version of the image. This second 
scanning pass is used to obtain the position of the meta-text described above. 

The third feature associated with the document importing utility 161 is the 
foiled import recovery feature. If. upon importing a document mto tiie document 
collection, the file import module is unable to determine the document format, the 
20 user is prompted to define the format. 

BROWSING DOCUMENTS 

The present invention includes a document browsing utility 163. The 
Browser utility 163 permits the user to quickly and efficientiy review the document 
collection or a portion thereof. Moreover, it aUows the user to view the 
25 documents and ihe document categories as they are logically arranged in the 

organizational tree described above. In addition, the Browser utiUty 163 permits 
the user to manipulate documents and document categories; to copy, move and 
delete documents and document categories; to view and print documents; and to 
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bundle multiple documents into a compound document entity referred to as a 
clipped document. Clipped documents are described in greater detail below. 

There are two basic user interfaces associated with the Browser utility 163. 
The first is referred to as My Computer, as illustrated in FIG. 10. When viewing 
5 documents and document categories with die My Computer interface, there is one 
display panel 1015 for displaying a representation of each document, clipped 
docimient or folder. In FIG. 10, the document representations are displayed as 
thtmibnails, although other representations are available such as small or large 
icons. The second user interface is referred to as the Explorer inter&ce, as 

10 illustrated in FIG. 11. In contrast. Explorer has two display panels: a right display 
panel 1 105 and a left display panel 1 1 10. While the left panel 1110 displays the 
folders and/or document categories, including the one currently opened, the right 
panel 1105 displays a representation of each document, clipped document and/or 
folder associated with the cuirently opei^ folder or document category. Again, 

15 the representations appearing in the right panel 1105 can take the form of 

thumbnails, small icons, or large icons. In FIG. 11, the representations are in the 
form of small icons. 

The Browser utility 163 allows the user to interact witti the docimients in 
the document collection in a number of different ways; Using a mouse or cursor, 

20 the user can open documents in a ixlixei^iiding host application. The user can 
open a category and display the documents, clipped documents, folders and/or 
subcategories associated therewith. The user can open a context menu 1115 for a 
given document, as shown in FIG. 11, wherem the context menu 1115 provides 
the user with a number of additional options as illustrated. 

25 These two user interfaces associated with the Browser utility 163, My 

Computer, as illustrated in FIG. 10, and Explorer, as illustrated in HG. 11, each 
have a number of standard pull-down menus. The FILE pull-down menu, for 
example, allows the user to, among other options, open documents, clipped 
documents, or document categories; send documents or clipped documents as e- 

30 mail messages; create new categories; import new documents from the scanner; 
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delete, rename and/or list the properties of docximents, clipped documents and 
categories. The EDIT menu allows the user to copy, paste, select all or part of a 
document. This menu also allows the user to clip or unclip documents. The 
VIEW menu, among other options, allows the user to display a customizable 
5 application toolbar, to be described below, and to control the arrangement and 
display representation of each document. In addition, there is also a TOOLS, 
TEST and a HELP menu. 

In order to import a document into the system's docimient collection from 
the Browser utility 163, a user can exercise one of several options. For example, 

10 a user can drag a document from the computer operating system desktop 

environment and drop it onto a Browser utility icon also appearing on titie desktop. 
If one of the two above-identified Browser utility interfaces is active, the user can 
drag a document from the desktop environment and drop it into one of the 
aforementioned panels in a location that is unoccupied by another icon or 

15 thumbnail. As described above, the categorization utility 159 automatically 

categorizes these dociunents based on the document attributes extracted and then 
stored in their corresponding STG files. The user can also drag a document from 
the desktop environment into a particular category representation appearing in the 
Browser interface, thus, manually categorizing the document. Finally, the user 

20 can cut and paste all or part of a document, or the user can scan in a document. 

The user can also initiate a scanning operation from the Browser utility 
163. A representation of the scanned image can be displayed on the desktop or 
scanned direcdy into one or more categories based on the user specified scanner 
options described above. This too is handled by a task manager utility 165 which 

25 is described in greater detail below. 

The user may also opt to display the customizable application toolbar, 
mentioned above, with either of the two Browser interfaces. An exemplary toolbar 
1205 is illustrated in HG. 12. The toolbar 1205 makes it easier for the user to 
directly interact with documents maintained in the document collection. For 

30 example, by employing the toolbar 1205, the user is able to drag and drop 
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application program icons or buttons (i.e., buttons or icons which, if selected, 
launch an application program such as Microsoft Excel, Microsoft Word, 
Netscape, or Wordperfect), thus allowing the user to quickly open one or more 
application programs and to convert, view and/or edit documents on-the-fly. This 
5 on-the-fly document conversion is accon[q>lished by enq>loying conversion filters to 
convert the various file formats. As stated, the user is able to quickly execute 
other ftmctions with the customizable application toolbar, such as send e-mail, 
transmit facsimiles, and initiate print jobs. 

The Browser utility 163 is also capable of displaying a representation for 

10 one or more transitional documents. A transitional document is a document that is 
currently being processed by the importmg utility 161. During the period in which 
a document is being processed by the inq>orting utility 161, the Browser utility 163 
displays an "in-transition" icon for that document, for example, the in-transition 
icons 1305 shown in FIG. 13. However, an in-transition icon is a temporary 

15 representation. When the importing utility 161 finishes processing the document, 
the Browser utility 163 automatically replaces the in-transition icon with the 
appropriate thumbnail representation, a small icon or a large icon, depending upon 
the current Browser utility display settings described above. In-transition icons 
provide the user with an easily recognizable representation for each of the one or 

20 more transitional documents. - 

SEARCHING DOCUMENTS 

The present invention also iiK:ludes a document searching utility 167. The 
searching utility 167, in turn, employs a search engine that globally searches the 
document collection (i.e., the STG files in the STG file durectory) and retrieves 
25 documents that fit or match a number of user-defined conditions with respect to 
text, meta-text, and/or other file attributes (e.g., document author, date, size, 
format). 
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In a preferred embodiment of the present invention, there are two search 
types which the user can initiate: a basic search and an advanced search. The 
basic search allows the user to search the document collection using a search query 
that contains only words or phrases. The advanced search allows the user to build 
5 a query that contains words and/or phrases as well as other file attributes, and it 
allows the user to combine the various words, phrases and other file attributes with 
boolean operators. 

Whether the user invokes a basic search or an advanced search, the 
searching procedure is essentially the same. The user enters a desired query, then 

10 selects a FIND NOW option in the corresponding user interface, which is 

described in greater detail below. The results are then displayed. The user then 
selects one or more of the identified documents, if desired. 

As stated, there is a user interface for the basic search and a user interface 
for the advanced search. The user interface for flie basic search is illustrated in 

15 HG. 14. As shown in FIG. 14, the user mterface is divided into an upper portion 
1405, which is reserved for building search queries, and a lower portion 1410, 
where the results of a given search are displayed. The lower portion 1410 is 
referred to as the results listbox. 

After tiie user builds a basic search query, the user selects the FIND NOW 

20 option 1415 on the user interface to initiate the search. The search engine then 
performs the search for that query. As the indexing oigii^ fiiKls a dociunent that 
matches the search criteria defined by the search query, the indexing engines 
informs the search utility 167. The search utility 167, in turn, displays the name 
of the document in the results listbox 1410 of the basic search user interface. At 

25 any time during the search, the user can select the STOP option 1420 oh the user 
interface, which forces the indexing engine to tenmnate the search. 

With regard to the results listbox 1410, the user can view the identified 
documents as small icons, large icons, thumbnails, or as a detailed list of 
documents. In an exemplary embodunent, the search utility 167 creates one or 

30 more smart folders and displays them m the results Ustt>ox 1410. Each of the one 
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or more smart folders has category criteria associated with a particular level of 
relevance (e.g., a nxmiber of search hits). Docxmients identified during the search 
are linked to one of these smart folders depending upon the actual relevancy of the 
document. For example, the search utility 167 may create two smart folders. The 
5 first smart folder's category criteria may be documents identified during the search 
operation having 10 or more search hits. In contrast, the second smart folder's 
category criteria may be documents identified during the searth having less than 
10 search hits. The search utility 167 then links the documents identified during 
the search to either the first or the second smart folder accordingly. The smart 

10 folders, along with the documents linked thereto are then displayed in the results 
listbox 1410. In another exanople, the search operation may create a number of 
smart folders which are displayed in the listbox 1410, wherein each smart folder 
may be linked to a group of docimients that share a certain number of key search 
terms. Alternatively, each smart folder may be linked to a group of documents 

IS containing key search terms that exhibit a certain sonantic similarity. 

In accordance with another exemplary embodiment, the search operation 
may identify one or more existing categories whose category criteria, in whole or 
in part, overlaps the key search query criteria. The search results might then be 
organized such that the one or more existing categories are listed. The user could 

20 then view those documents associated with each category that meet the search 
query criteria. 

The user can also select any number of retrieved documents, and then 
select the SIMILAR DOCS 1425 option on the basic search user interface. The 
search utility 167 then queries the indexing engine to identify all documents similar 
25 to those selected. For example, the indexing engine might identify all documents 
that are similarly categorized. The newly identified documents are then displayed 
in the results listbox 1410. 

The advanced search user interface is accessed through the basic search 
user interface by selecting the ADVANCED option 1430. The advanced search 
30 user interface is illustrated in FIG. 15. As stated above, the primary difference 
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between a basic search and an advanced search is that with an advanced search, the 
user can conduct more sophisticated searches with words, phrases, file attributes 
and/or a combination thereof using boolean operators. A file attribute refers to 
any number of file characteristics, for example, document size, publication date, 
5 author, or document source (i.e., files with a particular extension such as *.TIF, 
*.TXT, *.HTM). 

Although the advanced search user interface, like the basic search user 
interface, includes an upper portion 1505 for building search queries, and a lower 
portion 1510 for displaying search results, the advanced search user interface also 

10 includes a number of additional options not available for basic searching. For 
example, the user can modify the scope of an advanced search by entering a 
specific category in the SCOPE EDIT BOX 1515. By selectmg the BROWSE 
option 1520, a category tree is displayed, which allows the user to select, 
therefrom, a category for limiting the scope of the advanced search. Accordingly, 

15 the selected category is displayed m the SCOPE EDIT BOX 1515. The user can 
also limit the scope of an advanced search to the contents of each document, 
excluding document annotations; or the user can include the annotations; or the 
user can limit the search to only document annotations. This is accomplished by 
selecting the box 1525 entitled "Include Documents" and/or the box 1530 entitted 

20 "Include Annotations". Finally, the user can return to the basic search user 

interface by selecting the BASIC option 1535. If the user selects this option, all 
search conditions are lost except those containing exclusively words and/or 
phrases. 

VIEWING DOCUMENTS 

25 The next utility enq}loyed by the present invention is the document viewing 

utility 169. The document viewing utility 169 allows the user to view an entire 
document regardless of document type or document format, even if die 
corresponding host application cannot be launched. 
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The document viewing utility 169 user interface, as illustrated in FIG. 16, 
is accessed through the Browser utility 163. The document viewing user interface 
comprises two panes, a right pane 1605 and a left pane 1610, as illustrated in FIG. 
16. The left pane 1610 displays an icon or thumbnail of the document that is being 
5 viewed in the right pane 160S. In a preferred embodiment, a thimibnail 

representation is used if the document is an image. If, instead of a document, a 
clipped document is being viewed, then the icons or thumbnails for each individual 
document associated with the clipped document is displayed in the left pane 1610. 
The document viewing user interface, like the browser user interfaces, 

10 includes a customizable application toolbar 161S as illustrated in FIG. 16. Again, 
the toolbar 1615 is customizable in that the user can drag and drop functional 
buttons into the toolbar 1615 as described above, particularly buttons that, when 
selected, launch an application program which the user may need to properly view 
the documents. In addition, the toolbar 1615 may contain a number of functional 

15 buttons. In FIG. 16, the toolbar 1615 includes, from left to right, buttons for 
opening, saving, printing, hand scrolling, annotating, zooming, and advancing 
forward or back one page of the document being viewed. 

The document viewing utili^ 169 also highlights category criteria. In 
other words, it highlights the various key words, phrases, and/or attributes in the 

20 document being viewed, which make up the category criteria, assuming, of course, 
the document has been categorized. 

CLIPPED DOCUMENTS 

The present invention also utilizes a document clipping utility 171 . This 
utility allows a user to combine several documents into a conq)ound document 
25 entity herein referred to as a clipped document. More specifically, a clipped 

document is a form of compound document that contains zero or more documents 
of any type or format. For exan[Q>le, a clipped document may contain an image 
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document, a Microsoft Word document, a Wordperfect document and a web page 
in HTML format. 

Clipped documents are different from ordinary file folders. First, clipped 
documents maintain ttie order in which each component document appears. In 
5 other words, each of the component documents that are associated with a clipped 
document maintains a relative position within the clipped document with respect to 
the other component docvunents. Second, clipped documents provide the user with 
the ability to quickly and simply manipulate a set of related documents as a group. 
For example, a user can e-mail a clipped document to another user, and the other 
10 user actually receives the documents as a clipped document. If the host computer 
being operated by the other user is not executing the present invention, the other 
user receives each of the documents individually. 

Although the user can manipulate the component documents as a group, 
there are other instances when the component documents associated with a clipped 
15 document are manipulated individually. For example, the search engine, in 

performing a basic or advanced search, identifies each component document within 
a clipped document, assuming they meet the search criteria, including the level of 
relevance of each individual component document. 

As explained above, the present invention employs a virtual document 
20 storage feature. Accordingly, clipped documents do not physically contain a copy 
of each component document. Rather, each clipped document has a corresponding 
STG file, as described above, and as illustrated m FIG. 2B. The STG file 
associated with a clipped document contains a link to the STG file of each 
component document (see FIG. 2A). Once again, this virtual dociunent storage 
25 feature saves valuable memory space and it helps maintain document integrity 
(i.e., a single, up-to-date version of each document). 

Just as individual documents can belong to more than one category, clipped 
documents can belong to more than one category. A clipped document can also 
belong to no categories. 
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In a preferred embodiment, there are six ways in which a user can create a 
clipped document. First, from the Browser utility 163, a user can drag the 
representation of a sotu:ce document and drop it onto the representation of a 
destination document Dj, as illustrated in FIGs. 17A-17D. The Browser utility 
5 163 creates a new clipped document S in the category containing the destination 
document Dj, A representation of the new clipped document S then appears to 
subsume the representation of the destination document D2. At the same time, the 
soxurce document D, remains in the source category or be removed from the source 
category depending upon whether the user executes a copy operation or move 
10 operation. 

Second, from the Browser utility 163, a user can drag the representation of 
an existing clipped document and drop it onto a destination document. The 
Browser utility 163 causes the destination document to become concatenated with 
the clipped document, which in turn appears to subsume the representation of the 

15 destination document. A representation of a new clipped document, once again, 
appears in the category containing the destination document. Also, the existing 
clipped doctmient remains in or is removed from the source category depending 
upon whether the user executes a copy operation or a move operation. 

Third, from the Browser utility 163, a user can drag the representation of a 

20 source document and drop it onto the r^resentation of an existing clipped 

document in a destination category. Here, the soiuce document is appended to the 
existing clipped document in the destination category. Again, the source document 
remains in or is removed from the source category depending upon whether the 
user executes a copy operation or a move operation. 

25 Fourth, from the Browser utility 163, a user can drag the representation of 

a clipped document from a source category and drop it onto a representation of a 
clipped document in a destination category. Accordingly, the component 
documents associated with the source clq>ped document are appended to the 
destination clipped document. The source clipped document remains in or is 



-27- 



3NSOOCID:<WO 9918523A1 I > 



wo 99/18523 



PCT/US98/20483 



removed from the source category depending upon whether the user executes a 
copy operation or a move operation. 

Fifth, from the Browser utility 163, a user can simply create a new clipped 
document. The user can then designate that the clipped document is to be 
5 associated with a particular category. 

Sixth, from tfie document viewing utility 169, a user can drag the 
representation of a document in a source category or the representation of a 
clipped docmnent in a source category and drop it onto the representation of the 
document being viewed. The document or documents associated with the clipped 
10 document are appended to the document being viewed, thus creating a new clipped 
document in the category containing the document being viewed. Once again, the 
source document or source clipped document remains in or is removed from the 
source category depending upon whether the user executes a copy operation or a 
move operation. 

15 A user can also unclip a clipped document. Upon executing an unclipping 

operation, the representation of the clipped document is removed and the 
representations of the component documents are made visible in the corresponding 
Browser user interface. Additionally, the user can delete a clipped document, 
either locally or globally. From within a particular category, the user merely 

20 executes a delete clq>ped document command, wherein the Browser utility 163 
deletes the clipped document, along with the conniponent documents, from that 
category. From the "My Docimients" category, a user can execute a delete clipped 
document command, wherein the Browser utility 163 deletes the clipped document 
from every category. 

25 Other software applications, such as Microsoft Office, employ compound 

docmnent entities; however, these entities differ from clipped documents. For 
exan:q>le, Microsoft Office uses "binders". Unlike clq)ped documents, binders 
only allow a user to mix Microsoft Excel, Powerpoint and Word doamients. But 
binders do not allow the user to bind non-Microsoft Office formatted documents. 

30 Another major difference between binders and clipped documents is that binders 
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are monolithic documents. In other words, the component documents cannot be 
individually manipulated. In addition, a user of Microsoft Office cannot e-mail a 
binder to another person unless the other person is running Microsoft Office. Yet 
another difference between Microsoft Office binders and clipped documents is the 
5 fact that binders maintain a physical copy of each conq)onent document whereas 
the present invention employs a virtual document storage feature. As explained 
above, this is an inefficient usage of memory space, and it can lead to multiple 
versions of a single document, since a single document may be stored in more than 
one binder. 

10 FILE HELPER 

A next utility is the file helper or archiving utility 173. The file helper 
utility keeps the document collection tidy. More specifically, the file helper utility 
automatically archives files onto removable media, if, in general, those files have 
not been accessed or modified for a long period of time. The file helper utility 

15 also notifies the user if files have old dates; it notifies the indexing engine and ttie 
DCO file when files are taken off-line; it monitors the document collection for 
document duplicates; and it organizes a s^ande index of off-line documents. 

The file helper utility has a user interface, as illustrated in FIG, 18. As one 
skilled in the art will readily appreciate, the user interface illustrated in FIG. 18 

20 permits the user to select one or more various conditions that trigger the automatic 
archiving process. The file helper utility also prompts a user, if the user so 
desires, before the system archives a document in accordance with the user 
selected options. In addition, there are a number of secondary user interfaces 
associated with the file helper utility 173, for example, the user interface 

25 illustrated in HG. 19. The secondary user interfaces are utilized for entering more 
specific archiving conditions, such as the exact size of a document or the age of a 
document that trigger this archiving utility 173. 



"29- 



wo 99/18523 



PCTAJS98/20483 



The file helper utility continues to maintain a link to or an index of each 
archived document, by storing a thumbnail representation of each archived 
document and/or the STG file associated with each archived document. Therefore, 
if a user wishes to run a search involving archived documents, flie search engine is 
5 capable of searching the content of the thumbnail representations and/or the STG 
file data fields of each archived document. If the search identifies one or more 
archived documents, the file helper utility prompts the user to make the 
appropriate removable storage mediimi available (e.g., prompt the user to insert a 
particular floppy disk) in the event the user wishes to access the archived 
10 document. 

DIRECTORY MONITOR 

There is also a directory monitor utility 175 that monitors specific user- 
identified directories, categories, and/or folders on a particular storage device for 
newly stored documents. When the directory monitor utility 175 identifies newly 
15 stored documents, the categorization utility 159 automatically categorizes these 
documents into the appropriate categories or snoart folders, as described above. 
Again, there is a user interface associated with the directory monitor utility 175 as 
illustrate in FIG. 20. As shown, the user interface provides the user with a vehicle 
to select the particular directories to be monitored. 

20 TASK MANAGER 



The task manager utility 165 is yet another utility employed by the present 
invention. The task manager utility 165 is a multi-threaded single instance utility 
that is launched when the host computer is booted after loading the software 
associated with the present invention or upon a first request for one of its services 
25 after the utility has been turned off. Its main function, however, is to facilitate 
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background or batch processing jobs such as inq)orting documents into the 
document collection. 

The task manager utility 165 has a corresponding user interface, as 
illustrated in FIG. 21. The user interface includes a queue for displaying a list 
5 2105 of the various tasks currently being undertaken by the task manager utility 
165. 

When the task manager utility 165 is first initiated, for example, if the user 
executes a document import request, a small icon 2210 appears in the system task 
bar at the bottom of the display, as illustrated in FIG. 22. If the user selects the 

10 icon (with a mouse/cursor), the task manager utility 165 responds by opening the 
task manager utility 165 user interface. 

The task manager utility 165 user interface also inchides a nmnber of "pull- 
down" menus, as illustrated in FIG. 21, including a QUEUE menu and a JOB 
menu. The QUEUE menu includes, among other options, the option of stopping 

15 the task manager utility 165 from scanning or indexing a document, purging the 
queue, and terminating the task manager utility 165. The JOB menu provides 
options that include purging a document from the queue, and changing the priority 
in which the task manager utility 165 executes the jobs in the queue. 



ANNOTATIONS 



20 The present invention has an annotations utility 177 which provides the 

user with the option of adding annotations to a document before a scanning 
operation is completed. This feature allows the user to automatically manipulate 
an image document, including the added annotations, immediately upon completion 
of the scan. The user is also permitted to add aimotations of almost any type. For 

25 example, text annotations, free-form annotations (i.e., pictures and graphs), and 
waveform (i.e., audio) annotations. Drag and drop annotations are also available, 
if a user wishes to insert an annotation from one document into another document. 
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The user can even print annotations apart from the remainder of the accompanying document. 

PROPERTY SHEETS 

The present invention also has a property sheet utility 179. The property 
sheet utility 179 allows a user to display a property sheet for each individual 

5 category, clipped docimient and/or document. Property sheets are yet additional 
user interfaces which convey specific summary information about a given 
category, document and/or clipped document. This summary information may 
include particular document attributes such as document size, date, author, or the 
number of key words or attributes contained in a document. Moreover, the 

10 summary information for a particular document is stored in the STG file 

corresponding to that docuntient. Table I contains a list of potential attributes that 
might appear in a property sheet depending upon whether the property sheet 
pertains to a category, a clipped document or a document. Property sheets might 
also include a brief synopsis or abstract describing the contents of a given 

IS document. In accordance with a preferred embodiment, property sheets can be 
accessed either through the Browser utility 163 or the document viewing utility 
169. 
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The invention has been described with reference to a preferred exemplary 
embodiment. However, it will be readily apparent to those skilled in the art that it is 
possible to embody the invention in forms other fhaa those of the preferred embodiment 
described above. This may be done without departing from the spirit of the invention. 
The preferred embodiment is merely illustrative and should not be considered restrictive 
in any way. The scope of the invention is given by the appended claims, rather than the 
preceding description, and all variations and equivalents which fall within the range of 
the claims are intended to be embraced therein. 
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WHAT IS CLAIMED IS: 

1. A method for managing a document collection in a computer system, said 
method comprising the steps of: 

S importing a document having a first format into the computer system; 

storing the document in a memory location; 
automatically extracting attribute data from the document; and 
generating a data stmcture for the document, wherein said data stmcture 
contains the attribute data in a second format independent of said first format. 

10 

2. The method of claim 1, wherein said step of importing a document into the 
conq)Uter system comprises the steps of: 

optically scaiming a paper-based document; and 

converting the optically scanned document into an electronic document. 

15 

3. The method of claim 2, wherein the first fomiat is an image fomiat. 

4. The method of claim 2, wherein the first format is a text format. 

20 5. The method of claim 1 , wherein said step of importing a document into the 
computer system comprises the step of: 
importing an electronic document. 

6. The method of claim 5, wherein the first format is a text format. 

25 

7. The method of claim 6, wherein the document is a word processing document. 

8. The method of claim 6, wherein the document is an e-mail message. 

30 9. The method of claim 5, wherein the first format is an image format, 
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10. The method of claim 5, wherein the first format is an HTML format. 

1 1 . The method of claim 1 , wherein the second format comprises at least one data 
field. 

12. The method of claim 1 1 , wherein the at least one data field contains a file name. 

13. The method of claim 11, wherein the at least one data field contains the memory 
location. 



14. The method of claim 1 1 , wherein the data field contains a bit map. 

15, The method of claim 11, wherein the data field contains raw text. 

15 16. The method of claim 11, wherein the data field contains a data attribute. 

17. The method of claim 16, wherein the data attribute is an author name. 

18. The method of claim 16, wherein the data attribute is a publication date. 

20 

19. The method of claim 16, wherein the data attribute is a word count. 

20. The method of claim 16, wherein the data attribute is an annotation. 
25 21. The method of claim 16, wherein the data attribute is a key word. 

22. The method of claim 16, wherein the data attribute is an image type. 

23- The method of claim 16, wherein the data attribute is an nnage dimension. 
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24. The method of claim 16, wherein the data attribute is meta-text with positioning 
infomiation. 

25. The method of claim 1, further comprising the step of extracting indexing 
S information from the attribute data in the data structure. 

26. The method of claim 25 further comprising the steps of: 
monitoring modifications to the document; and 
extracting updated indexing information. 

10 

27. The method of claim 25, wherein the attribute data is derived from a data field 
comprising raw text data. 

28. The method of claim 25 further comprising the step of: 

15 identifying the doctiment from amongst other documents in the document 

collection utilizing the indexing information. 

29. The method of claim 1 further comprising the step of: 

linking the document to a first electronic folder if the attribute data matches a set 
20 of predefined criteria corresponding to the first electronic folder. 

30. The method of claim 29 further comprising the steps of: 
electronically analyzing the attribute data stored in the data structure 

corresponding to the document; 
25 determining whether the document is to be automatically linked to the first 

electronic folder; and 

identifying the document on an inclusion list if it is determined diat the 
document is not automatically linked to the first electronic folder. 

30 31. The method of claim 29 further comprising the steps of: 
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electronically analyzing the attribute data stored in the data structure 
corresponding to the document; 

determining whether the document is to be automatically excluded from being 
linked to the first electronic folder; and 
5 identifying the document on an exclusion list if it is determined that the 

document is not to be automatically excluded from being linked to the first electronic 
folder. 

32. The method of clakn 29 further comprising the steps of: 
10 monitoring document modifications; and 

automatically linking the document to a second electronic folder if a document 
modification causes the attribute data to match a set of predefined criteria corresponding 
to the second electronic folder. 



15 33. The method of claim 29 further comprising the steps of: 
monitoring document modifications; and 

automatically deleting the link between the document and the first electronic 
folder if a document modification causes the attribute information to no longer match 
the set of predefined criteria corresponding to the fim electronic foldCT. 

20 

34. The method of claim 29, wherein the attribute data is a document title. 

35. The method of claim 29, wherein the attribute data is a document author. 

25 36. The method of claim 29, wherein the attribute data is a phrase associated with 
the document. 

37. The method of claim 29, wherein the attribute data is a key word. 

30 38. The method of claim 29, wherein the attribute data is a common concept. 
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39. The methcxi of claim 29 further comprismg the step of: 

automatically manipulating the document based on a predefined behavior 
associated with the first electronic folder. 

5 40. The method of claim 39, wherein the predefined behavior is a user-defined 
behavior. 

41 . The method of claim 39, wherein the predefined behavior involves e-mailing the 
dociraient to a preprogrammed e-mail address. 
10 42. The method of claim 39, wherein the predefined behavior involves providing 
controlled access to the document. 

43. The method of claim 1 further comprising the steps of: 

linkmg the document to a folder, wherein the folder has associated with it a 
15 predefined behavior; and 

automatically manipulating the document in accordance with the predefined 
behavior. 

44. The method of claim 43, wherein the predefined behavior is a user-definbd 
20 behavior. 

45. The method of claim 43, wherein the predefined behavior involves e-mailing the 
document to a preprogrammed e-mail address. 

25 46. The method of claim 43, whereiin the predefined behavior involves providing 
controlled access to the document. 

47. The method of claim 1 further comprising the step of: 

maintaining a second data structure that includes data defining a document 
30 hierarchy for the document collection. 
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48. The method of claim 47 further comprising the step of: 

updating the second data structure to include data that defines a link between the 
data structure of the imported document and a docimient hierarchy folder or category. 

49. The method of claim 47, wherein the second data structure includes data linking 
5 all documents in the document collection to at least one folder or category. 

50. The method of claim 47 further comprising the step of: 

maintaining a third data structure that includes data defining a second document 
hierarchy for the document collection, or a portion thereof, wherein the thurd data 
10 structure is maintained at a local terminal connected to the computer system. 

51 . A computer-readable storage medium having stored therein a program which 
executes flie steps of: 

importing a document into a computer-based system; 
15 storing the document in memory; 

automatically extracting attribute data from the document; and 
generating a data stracture corresponding to the docimient conqprising the 

extracted attribute data in a standardized format regardless of document type or 

doctmient format. 

20 

52. The computer-readable storage medium in accordance with claim 51, wherein 
said program further comprises the executable steps of: 

predefining category criteria for a first electronic folder; and 
linking the document to the first electronic folder if the attribute data in the data 
25 structure corresponding to the document matches the category criteria. 

53. The computer-readable storage medium in accordance with claim 52, wherein 
said program further comprises the executable steps of: 

electronically analyzing the attribute data stored in the data structure 
30 corresponding to the document; 
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comparing the attribute data to the predefined category criteria for the first 
electronic folder; 

determining whether the document is to be automatically linked to the first 
electromc folder based on the comparison; and 
5 identifying the document on an inclusion list if it is determined that the 

document is not to be automatically linked to the first electronic folder. 

54. The computer-readable storage medium in accordance with claim 52, wherein 
said program further comprises the executable steps of: 

electronically analyzing the attribute data stored in the data stmcture 
corresponding to the document; 

comparing the attribute data to the predefined category criteria for the first 
electronic folder; 

determining whether the document is to be automatically excluded from being 
linked to the first electronic folder; and 

identifying the document on an exclusion list if it is determined that the 
document is not to be automatically excluded from being linked to the first electronic 
folder. 

55. The c6nq>uter-readable storage medium in accdr^nce with claiin 52, wherein 
said executable step of predefining category criteria for the first electronic folder 
comprises the steps of: 

storing a seed docimient in the first electronic folder; 
analyzing the seed document; and 
extracting the category criteria from the seed document. 

56. The conq>uter"readable storage medium in accordance with claim 58, wherein 
the predefined category criteria is based on user-defined criteria. 
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57. The computer-readable storage medium in accordance with claim 58, wherein 
said program further comprises the executable steps of: 

monitoring document modifications; and 

automatically linking the document to a second electronic folder if the attribute 
5 data now matches predefined category criteria associated with the second electronic 
folder. 

58. The computer-readable storage medixmi in accordance with claim 52, wherein 
said program further comprises the executable steps of: 

10 monitoring document modification; and 

automatically deleting the link between the document and the first electronic 
folder if the attribute data no longer matches the predefined criteria associated with the 
first electronic folder. 

15 59. The computer-readable storage medium in accordance with claim 52, wherein 
the attribute data is a document title. 

60. The computer-readable storage medium in accordance with claim 52, wherein 
the attribute data is a document author. 

20 

61 . The computetr-readable storage medium in accordance with claim 52, wherein 
the attribute data is a phrase associated with the document. 

62. The computer-readable storage medimn in accordance with claim 52, wherein 
25 the attribute data is a conunon concept. 

63. The computer-readable storage medium in accordance with claim 52, wherein 
the attribute data is a key word. 
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64. The computer-readable storage medium in accordance with claim 51 , wherein 
said program further comprises the executable steps of: 

linking the document with an electronic folder; and 
manipulating the document automatically based on a predefined behavior 
5 associated with the electronic folder. 

65 . The computer-readable storage medium in accordance with claim 64, wherein 
the predefined behavior is a user-defined behavior. 

10 66. The con^uter-readable storage medium in accordance with claim 64, wherein 
the predefined behavior involves e-mailing the docimient to a preprogrammed e-mail 
address. 

67. The computer-readable storage medium in accordance with claim 64, wherein 
15 the predefined behavior involves providing controlled access to the document. 

68. The computer-readable storage medium in accordance with claim 51, wherein 
said step of importing a document into the computer-based system comprises the 
executable steps of: 

20 generating program instructions thus causing ah optical scanner, connected to 

the computer system, to optically scan the document, wherein the document is a paper- 
based document; and 

converting the optically scanned document into an electronic document. 

25 69. The computer-readable storage medium in accordance with claim 68, wherein 
the electronic document is an image file. 

70. The computer-readable storage medium in accordance with claim 68, wherein 
the electronic document is a text fUe. 



30 
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71 . The computer-readable storage medium in accordance with claim 51, wherein 
said step of importing a document into the computer system comprises the executable 
step of: 

importing an electronic document. 

5 

72. The computer-readable storage medium in accordance with claim 71, wherein 
the electronic document is a word processing document. 

73. The computer-readable storage medixmi in accordance method of claim 71, 
10 wherein the electronic document is a docxunent containing an image. 

74. The computer-readable storage medium in accordance method of claim 71 , 
wherein the electronic document is an e-mail message. 

15 75. The computer-readable storage medium in accordance method of claim 71 , 
wherein the electronic document is an HTML document. 

76. The computer-readable storage medium in accordance with claim 51, wherein 
said program further comprises the executable step of: 

20 extracting indexing information from the attribute data in the data structure. 

77. The computer-readable storage medium in accordance with claun 76, wherein 
said program further comprises the executable steps of: 

monitoring modifications to the document; and 
25 extracting updated indexing information. 

78. The computer-readable storage medium in accordance with claim 76, wherein 
the attribute data is derived from a data field in the data stracture comprising raw text 



data. 
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79. The computer-readable storage medium in accordance with claim 76, wherein 
said program further comprises the executable step of: 

identifyuig the document from amongst other documents stored in the computer 
system utilizing the indexing information. 

5 

80. The computer-readable storage medium in accordance with claim 51 , wherein 
said program further comprises the executable step of: 

maintaining a second data stmcture that includes data defining a document 
hierarchy for the document collection. 

10 

81 . The computer-readable storage medium in accordance with claim 80, wherein 
said program further comprises the executable step of: 

updating the second data structure to include data that defines a link between the 
data structure of the imported document and a document hierarchy folder or category. 

15 

82. The computer-readable storage medium in accordance with claim 80, wherein 
the second data structure includes data linking all documents in the docimient collection 
to at least one folder or category. 

20 83. The computer-readable storage medium in accordance with claim 80, wherein 
said program further comprises die executable step of: 

maintaining a third data stmcture that includes data defining a second document 
hierarchy for the document collection, or a portion thereof, wherein the third data 
structure is maintained at a local terminal connected to the computer system. 
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